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EFFECTIVE BUS UTILIZATION USING MULTIPLE 
BUSES AND MULTIPLE BUS CONTROLLERS 

BACKGROUND 



1. Field of the Invention 

[0001] This invention relates to computer architecture. In particular, the 

invention relates to multi-master systems. 

2. Description of Related Art 

[0002] In a typical microprocessor system, a common bus is used to 



interface to the central processing unit (CPU), program memory, data memory, 
peripheral devices, direct memory access (DMA) controller, and other bus masters 
or slaves. In this traditional single bus system, only one master can use the bus at 
a time. 

[0003] One technique to improve bus utilization is cycle stealing. Cycle 

stealing allows a master to steals some cycles from another master that is 
controlling the bus. This technique avoids bus monopoly by a master. However, 
the technique is limited to the maximum bandwidth of a single bus and requires 
extra circuit to provide cycle stealing operations. 

[0004] Therefore, there is a need to have a technique to provide efficient 

bus accesses in a multi-master system. 

SUMMARY 

[0005] The present invention is a method and apparatus to provide 

efficient bus accesses in a multi-master system. In one embodiment of the present 
invention, a bus controller is used in a multi-master system having first and 
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second processors. The bus controller includes a bus arbiter and a first 
multiplexer. The bus arbiter is coupled to the first and second processors via first 
and second master buses, respectively, to generate an arbitration select signal 
based on result of arbitrating bus access information fi-om the first and second 
processors. The first multiplexer is coupled to the first and second master buses 
and a first slave bus in a plurality of slave buses to provide device access 
information selected from the bus access information using the arbitration select 
signal. The device access information is transferred to a first slave device 
connected to the first slave bus. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] The features and advantages of the present invention will become 

apparent from the following detailed description of the present invention in which: 

[0007] Figure 1 is a diagram illustrating a system in which one 

embodiment of the invention can be practiced. 

[0008] Figure 2A is a diagram illustrating data flows for multiple accesses 

for the system shown in Figure 1 according to one embodiment of the invention. 

[0009] Figure 2B is a diagram illustrating data flows for multiple accesses 

for the system shown in Figure 1 according to one embodiment of the invention. 

[0010] Figure 3 is a diagram illustrating a bus controller shown in Figure 1 

according to one embodiment of the invention. 

[0011] Figure 4 is a diagram illustrating a common memory interface 

shown in Figure 1 according to one embodiment of the invention. 
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DESCRIPTION 



[0012] In the following description, for purposes of explanation, numerous 

details are set forth in order to provide a thorough understanding of the present 
invention. However, it will be apparent to one skilled in the art that these specific 
details are not required in order to practice the present invention. In other 
instances, well-known electrical structures and circuits are shown in block 
diagram form in order not to obscure the present invention. 

[0013] Figure 1 is a diagram illustrating a system 100 in which one 

embodiment of the invention can be practiced. The system 100 includes N 
processors UOi to 1 1 On, N master buses 115i to 115n, a master bus interface 
circuit 120, K slave buses 135i to 135k, slave devices 140jk 0"=1, • • -^.K, k = 
1 , . . . ,L, I , . . . M, I , . . . , K), a common memory interface 150, and a common 
memory 160. 

[0014] Each of the N processors 11 Oi to 1 1 On is coupled to each of the N 

master buses 115i to 1 15n , respectively. The processors 1 lOi to 1 IOn are any 
processors that are capable of controlling their corresponding buses master buses 
1 15i to 1 15n. The ability to control the bus includes asserting mastership, issuing 
access control signals (e.g., read and write), issuing address and data, etc. A 
processor that can have control of a bus is referred to as a master. A device that 
can only receive information on the bus is referred to as a slave. Examples of the 
processors 11 Oi to 1 IOn include microprocessor, digital signal processor, micro- 
controller, direct memory access (DMA) controller, etc. Examples of a slave 
include memory devices, peripheral devices (e.g., serial communication, parallel 
input/output devices). The N master buses 1 1 5 1 to 1 1 5n may be homogeneous or 
heterogeneous. Examples of include the Peripheral Interconnect Component 
(PCI) bus, the Industry Standard Adapter (ISA), or any specially designed bus. 

[0015] The master bus interface circuit 120 provides interface between the 

N master buses 1 1 5i to 1 1 5n and the K slave buses 135i to 135k. The master bus 
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interface circuit 120 includes K bus controllers 130i to 130k. Each of the K bus 
controllers 130i to 130k is connected to the N processors llOi to 1 IOn via the N 
master buses 1 1 5i to 11 5n , respectively, and each of the corresponding K slave 
buses 1 35 1 to 135k- By having an individual bus controller for each of the K slave 
buses 1 35 1 to 135k, the master bus interface circuit 120 allows any of the N 
processors 1 1 0 1 to 1 1 On to access any of the K slave buses 135itol35K. 

[0016] The K slave buses 135i to 135k provide access to slave devices. 

Each of the K slave buses 1 35 1 to 135k is connected to a number of slave devices 
140j], (j = 1, . . .,K, k = 1,. . • M, 1,. . K),. The L slave devices MOu to 

140iL are connected to the slave bus 135i, . . ., the M slave devices I4O21 to 1402M 
are connected to the slave bus 1352, .. ., the P slave devices 140ki to 140kp are 
connected to the slave bus 135k. The K slave buses 135i to 135k may be 
homogeneous or heterogeneous, i.e., there may be a set of slave buses of the same 
type and other sets of slave buses of different types, or all the slave buses are of 
the same type. The slave devices may be any type of device that cannot or does 
not have control of the master buses. Examples of these slave devices 140jk (}='l, . 
. .,K, k = 1,.. .,L, 1,. . . M, 1,. . ., K) include slave processors, micro-controllers, 
memory devices, peripheral input/output (I/O) devices, network interface, printer 
controller, disk drive controller, media interface (e.g., graphics, audio, video), etc. 
Memory devices include random access memory (RAM), read only memory 
(ROM), flash memory, or even mass storage device such as compact disk (CD) 
ROM, floppy diskette, and hard drive. 

[0017] The common memory interface 1 50 is connected to the K slave 

buses 135i to 135k and the common memory 160 to allow any of the N processors 
1 lOi to 1 IOn, or even any of the slave devices 140jk (j = 1, . . .,K, k = 1,. . .,L, 1,. . . 
M, 1,. . ., K ) to access the common memory 160. The common memory 160 is a 
memory that is common to all the N processors 1 lOi to 1 IOn. hi other words, any 
of the N processors 11 Oi to 1 IOn can access the common memory 160 via an 
appropriate datapath. Typically, the common memory 160 stores information that 



080398.P346 



-4- 



is relevant to most or all processors and slave devices. The common memory 160 
may contain data, records, structures, linked lists, configuration data, status 
information, messages, mails, etc. The common memory 160 may also contain 
program segments, routines, functions, library of functions, etc., that can be used 
by any of the N processors 1 Id to 11 On- The common memory 160, therefore, 
may be program memory, data memory, or a combination of both. 

[0018] Figure 2 A is a diagram illustrating data flows for multiple accesses 

for the system shown in Figure 1 according to one embodiment of the invention. 

[0019] In this illustrative example, processor lid is a DMA controller 

that transfers a block of data from one device to another device (e.g., data 
memories), and processor 1 1 On is a microprocessor that accesses a program 
memory and a common data memory. 

[0020] The processor 1 1 d follows two data paths 2 1 0 and 220. The 

processor 1 lOi performs a DMA from the slave device 140ii to the slave device 
14021. The processor 11 Oi provides access information (e.g., read address) to the 
slave device 140ii via the data path 210 going through the master bus 1 15i, the 
bus confroUer 130i in the master bus interface circuit 120, the slave bus 135], and 
then to the slave device 140ii. The processor reads a block of data from the slave 
device 140ii, then provides access information (e.g., address and write data) to the 
slave device 1402 1 via the data path 220 going through the master bus 1 15i, the 
bus controller ISOi, the slave bus 1352, and then to the slave device I4O21. 

[0021] The processor 11 On follows a data path 230. For example, the 

processor 1 1 On is a microprocessor fetching instructions from a program memory 
stored in slave device 140ki. The data path 230 goes through the master bus 1 15n, 
the bus confroUer 135n, the slave bus 135K, to the slave device 140ki. The 
processor 11 On may also follow data path 240 to go through the common memory 
interface 150 and to the common memory 160. 
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[0022] It is noted that the two processors 1 lOi and 1 IOn can perform their 

respective function simultaneously. The two processors follow separate and 
independent data paths and therefore there is no bus conflict or contention. In this 
illustrative example, the DMA controller 1 lOi can perform DMA transfers 
efficiently while the microprocessor 11 On continues program execution. It is also 
noted that use of two processors is for illustrative purposes only. Any number of 
processors can have concurrent accesses to their respective slave devices. 

[0023] Figure 2B is a diagram illustrating data flows for multiple accesses 

for the system shown in Figure 1 according to one embodiment of the invention. 

[0024] In this illustrative example, processor I lOi is a DMA controller 

that transfers a block of data from one device to the common memory, and 
processor 1 IOn is a microprocessor that writes data to two peripheral devices. 

[0025] The processor 11 Oi follows two data paths 240 and 250. The 

processor 11 Oi performs a DMA from the slave device 140ii to the common 
memory 160. The processor 1 lOi provides access information (e.g., read address) 
to the slave device HOn via the data path 240 going through the master bus 115i, 
the bus confroller 130i in the master bus interface circuit 120, the slave bus 135i, 
and then to the slave device 140ii. The processor reads a block of data from the 
slave device 140ii, then provides access information (e.g., address and write data) 
to the common memory 160 via the path 250 going through the master bus 1 15i, 
the bus controller 130], the slave bus 135], the common memory interface 150, 
and then to the common memory 160. 

[0026] The processor 1 IOn follows two data paths 260 and 270. For 

example, the processor 1 IOn is a microprocessor writing data to both slave devices 
I4O21 and 140ki ■ The data path 260 goes through the master bus 1 15n, the bus 
controller 1352, the slave bus 1352, to the slave device I4O21. The datapath 270 
goes through the master bus 11 5n, the bus confroller 135n, the slave bus 13 5k, to 
the slave device 140ki. 
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[0027] As in the illustrative example shown in Figure 2B, the two 

processors 11 Oi and 1 IOn can perform their respective function simultaneously. 
The two processors follow separate and independent data paths and therefore there 
is no bus conflict or contention. Again, any number of processors can access their 
respective slave devices via the bus controller 120. 

[0028] Figure 3 is a diagram illustrating a bus controller 130j shown in 

Figure 1 according to one embodiment of the invention. The bus controller 130j 
includes a bus arbiter 310, a write multiplexer 320, an address decoder 330, a read 
multiplexer 340, and a de-multiplexer 350. 

[0029] The bus arbiter 3 10 is connected to the N processors 1 lOi to 11 On 

via the N master buses 115i to 115n. The bus arbiter 310 generates an arbitration 
select signal 315 based on result of arbitrating bus access information from the N 
processors 11 Oi to 1 IOn- The arbitration may be based on some predefined 
prioritization scheme. The prioritization may be fixed or static or variable or 
dynamic. In a static prioritization, each processor is assigned a fixed priority 
level. When two or more processors access the same slave bus, the processor 
having higher priority level will be given control, hi a dynamic prioritization, the 
priority level is variable and may be based on some dynamic algorithm. For 
example, each priority level may be adjusted up or down depending on how 
frequently the corresponding processor has been allowed to have access to the bus. 
The arbitration select signal 315 essentially encodes the processor select 
information, which can be used to select the corresponding processor that is given 
access. 

[0030] The write multiplexer 320 is used to transfer the device access 

information from the selected processor to the destination slave device. The N 
inputs of the write multiplexer 320 are connected to the N master buses 1 15i to 
1 15n. The output of the write multiplexer is connected to one of the slave buses 
135i to 135k- Each of the bus controllers 130i to 130k is assigned to each of the 
slave buses 135i and 135k. The arbitration select signal 315 selects the bus access 
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information from the processor that wins in the arbitration. The selected device 
access information is then transferred to the corresponding slave bus and directed 
to the destination slave device connected to that slave bus. The device access 
information includes information relating to the device access such as the device 
request, the slave address and the data to be written to the slave device. 

[0031] The address decoder 330 is connected to the bus arbiter 3 1 0 and the 

write multiplexer 320 to decode the slave address as provided by the device access 
information from the write multiplexer 320. The decoded slave address specifies 
the destination slave device. The address decoder 330 generates a number of 
device select signals, one of which is active to correspond to the destination slave 
device. The address decoder 330 also generates a device select signal 335 based 
on the specified slave address. The device select signal 335 is used to select 
device response information from the read multiplexer 340. 

[0032] The read multiplexer 340 is connected to the designated slave bus 

to provide bus response information from the device response information using 
the device select signal 335. The device response information includes a device 
ready signal and the read data provided by the specified slave device. 

[0033] The de-multiplexer 350 is connected to the read multiplexer 340 

and the N processors 1 1 Oi to 1 1 On to transfer the bus response information from 
the read multiplexer 340 to the processor that wins the arbitration as provided by 
the arbitration select signal 315 from the arbiter 310. The de-multiplexer 350 may 
be implemented by tri-state bus drivers connected to the N master buses 11 5i to 
1 15n, and a decoder. The decoder decodes the arbitration select signal 315 into N 
enable signals one of which is active. The active enable signal corresponds to the 
processor that wins the arbitration. 

[0034] The bus controller 1 30j therefore provides bi-directional access 

between the N master buses 1 1 5 1 to 1 1 5n and the slave bus 1 35j. hi addition, the 
bus confroller 130j allows any one of the slave devices connected to the slave bus 
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135j to be accessed. Since there are K bus controllers in the master bus interface 
circuit 120 corresponding to K slave buses 135i to 135k, respectively, concurrent 
or parallel accesses between any of the processors 1 lOi to 1 1 On to any of the slave 
devices is possible. 

[0035] Figure 4 is a diagram illustrating the common memory interface 

150 shown in Figure 1 according to one embodiment of the invention. The 
common memory interface 150 includes a multiplexer 410, a de-multiplexer 420, 
and an interface controller 430. 

[0036] The multiplexer 420 has K inputs connected to K slave buses 1 3 5 1 

to 135k. The output of the muhiplexer 420 is connected to the common memory 
160. The multiplexer 420 transfers the common memory access information to 
the common memory 160 using a select signal provided by the interface controller 
430. The common memory access information includes memory select signals 
and data to be written into the common memory 160. 

[0037] The de-multiplexer 420 routes the memory access information to 

the proper slave bus based on another select signal provided by the interface 
controller 430. The de-multiplexer 420 may be implemented by K tri-state bus 
drivers and a decoder which is used to enable one of the K tri-state bus drivers. 
The K tri-state bus drivers are connected to the K slave buses 135i to 135k- The 
memory access information includes the read data provided by the conmion 
memory 160 to the selected slave bus. 

[0038] The interface controller 430 includes circuit to generate select 

signals based on the control signals from the N processors 1 1 Oi to 1 1 On or based 
on one designated supervisor processor within the N processors 1 lOi to 1 IOn- 

[0039] By coupling to K slave buses 135i to 135k, the common memory 

interface 150 allows any of the N processors 11 Oi to 1 IOn or any of the slave 
devices 140jk to have access to the common memory 160. 



080398.P346 



-9- 



[0040] While this invention has been described with reference to 

illustrative embodiments, this description is not intended to be construed in a 
limiting sense. Various modifications of the illustrative embodiments, as well as 
Other embodiments of the invention, which are apparent to persons skilled in the 
art to which the invention pertains are deemed to lie within the spirit and scope of 
the invention. 



080398.P346 



-10- 



